The Japanese Government Joins Forces with Tech Giants to Invest Hundreds of Millions in Developing a Japanese Language Model

The Japanese government collaborates with tech giants such as NEC, Fujitsu, and SoftBank to invest hundreds of millions in developing a culturally sensitive Japanese language model. The new model will be trained on the national supercomputer Fugaku, boasting at least 30 billion parameters, with performance expected to significantly outshine existing models. The goal is to address shortcomings of current models in the Japanese market, such as generating rare characters and culturally inappropriate communication norms. Researchers have developed the Rakuda ranking system to assess the model's sensitivity to Japanese culture, with GPT-3.5 currently ranking first. The Japanese government also...